All Questions
Tagged with character-encodinglinux
35 questions
2votes
1answer
1kviews
How to change ISO-8859 text with CRLF line terminators
I am trying to change the encoding of a text file to UTF-8. I am new to Unix so any help would be great. I am not sure how to code it properly with recode function.
0votes
1answer
95views
testdisk utility reports nonexistent files from a exFAT drive used with Windows - why?
I tried to recover lost files from an exFAT thumb drive with the testdisk package on linux. It was very good at finding deleted files. However as I went through the entries, I saw weird entries. The ...
1vote
1answer
75views
head and grep display text different than gedit
I try to get some information from log file, but I get numbers using grep and I want get text like I see in gedit. Result of file command: ASCII text, with CR, LF line terminators Also I checked that ...
0votes
1answer
1kviews
Unable to change file encoding to utf-8
I modified a UTF-8 encoded xml file using vi editor and saved it. I'm on Redhat Linux 7.9 I checked the file encoding after the changes and found it to be us-ascii file --mime-encoding tmpfiles/08/...
0votes
0answers
27views
Weird characters in output file [duplicate]
I opened the output file created from a script in my terminal and the output file is fine, shows the output i want. cat 2_val.txt 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 2 2 3 3 3 3 3 3 3 3 3 3 4 4 4 4 4 ...
3votes
1answer
346views
Can I determine at runtime the available NLS character sets?
I can find the list of the kernel's supported filesystem types in /proc/filesystems. Is there a way to determine which character sets I'm able to use with the mount options iocharset or nls, other ...
1vote
1answer
5kviews
Finding text file's encoding
The iconv command may change file encodings. But is there a command to find the file encoding of a certain text file. Also, I am trying to find what file encoding standards each country use. So that I ...
-1votes
1answer
206views
how to remove non-standard end of line characters in bash? [closed]
Sometimes, when passing the name of files from a config.txt into a pipe, I get weird problems of non-existing files. I fear it is due to some non-standard end of line characters. I am using kate as ...
1vote
1answer
1kviews
Decode Cyrillic strings
How to decode strings on a text files like this: Âèòàëèé This analyzer (https://2cyr.com/decode/?lang=en) detected the source encoding as WINDOWS-1251 + displayed as ISO-8859-1, and successfully ...
0votes
1answer
222views
How to fix malformatted special characters in Pop OS, that occoured after an system crash?
This afternoon my computer (operating Pop OS!) was not reacting to keyboard or mouse interactions, I tried everything but couldn't find out why this happened. So I did a cold start, I assume the ...
0votes
1answer
728views
Replace character in file based on position
I work on the encoding of a file, from unknown-8bit to UTF-8. but I got an error message. iconv: illegal input sequence at position 136828 So I did a search in the file with the position like this : ...
1vote
0answers
141views
Broken pipe symbol from SQL changing in Linux
I am migrating Solaris code to Linux and have problem with broken pipe symbol used inside sql scripts. There are multiple SQL scripts (and output it produces) with broken pipe symbol (¦) which works ...
0votes
2answers
4kviews
How to fix strange characters in my .txt file?
I edited a .txt file in Visual Studio on Windows and then copied that into a HPC server. The file looks fine to me at first, But when I opened it in the linux environment, weird characters showed up (...
1vote
0answers
50views
If I know the corresponding encoded bytes to some characters, how can I determine matching charsets?
I have a few files where the filenames obviously use the wrong charset. As soon as I know which charset is being used, I can use convmv to convert it to UTF-8. From the rest of the filename, I can ...
4votes
1answer
569views
UTF8 Character Makes File Inaccessible
If I run: scp [email protected]:/home/me/cömmön_file.jpg /home/me/ from my remote server I get: scp: /home/me/cömmön_file.jpg: No such file or directory If I swap out the utf8 characters though ...